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Abstract 

In these notes I will review the results that have been obtained in these last years on the 
computation of the number of metastable states in infinite-range models of disordered systems. 
This is a particular case of the problem of computing the exponentially large number of stationary 
points of a random function. Quite surprisingly supersymmetry plays a crucial role in this problem. 
A careful analysis of the physical implication of supersymmetry and of supersymmetry breaking 
will be presented: the most spectacular one is that in the Sherrington-Kirkpatrick model for spin 
glasses most of the stationary points are saddles, as predicted long time ago. 

1 Introduction 

The Hamiltonians of simple (soluble) models of spin glasses are often of the following type pOj: 

H=^J2J^Mi)'^ik), (1) 
i,k 

where the variables J are quenched random variables and the spins a take the value ±1. 

Some of the mostly studied infinite-range models (that are soluble) are the Sherrington Kirkpatrick 
(SK) model HEHIEI and the Bethe lattice model PHI. 

• In the SK model the J's are random variables with zero average and variance 1/N 1. In the 
nutshell the J's form a random Gaussian matrix whose spectrum is given by the semicircle law. 

• In the Bethe lattice model we consider a graph with N nodes and M = 2zN edges. A node has 
in the average z neighbors; in a generic graph, in the limit going to infinity, the distribution 
of the number of the neighbors of a node is a Poisson distribution. The graph is locally loopless, 
in the sense that loops of fixed lengths disappear when goes to infinity: the typical length of a 
loop is log(iV). This graph is called a Bethe lattice because the appropriate Bethe approximation 
is exact on such a lattice. The Hamiltonian has the same form as before, with the difference that 
the J's are non-zero only on the edges of the graph. We normalize the J's in such a way that 
their variance equal to z"^/^. The advantage of this normalization is that in the limit z — > oo 
the Bethe lattice model become the SK model. 

There are many other models and many variations are possible. For example sometimes the analysis 
is simplified by using real-valued variable cr, that satisfy the spherical constraint J2i=i n "^(0^ = 
There are also systems with three- (or more-)spins interactions. Other systems still have two-spins 
interactions, but they are characterized by a different distribution of the J's, e.g the J's form a random 



^They may have either a bimodal distribution or a Gaussian distribution, but these details are irrelevant in the large 
A'^ limit as soon as the kurtosis is finite 
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matrix with a preassigned form of the spectrum; it is also possible to consider the case where the J's 
form a non-random matrix jH) 1^1 El as in the sine model ^ ; 



f2mk\ 

VIT) ■ 



Ji,fc = N^'^ sm 

Usually one introduces a J-dependent partition function and a J-dependent free energy: 



= In(Zj) . (3) 

One is interested in computing the probability distribution of fj as function of the J's. However the 
free energy density 

Fj = — (4) 

converges (with probability 1) to a J- independent value {F) when N goes to infinity. We must be 
careful however in doing the average of the logarithm of Zj, because the average of Zj may be much 
larger of its most likely value. These models are soluble in the limit of large N in the sense that the 
free energy F and other thermodynamic quantities are computable in this limit. 

Spin glasses are also interesting from the point of view of computer science because the computation 
of the ground state of a spin glass is an NP complete problem Spin glasses have unexpected properties 
(at least in the aforementioned soluble models); the most spectacular is the existence of many phases at 
infinitesimal magnetic field, in variance with what happens in standard ferromagnetic models where 
there is usually only one phase. A detailed analytic computation shows that there are an infinite 
number of phases or states, more precisely the number of phases increases in an unbounded way with 

I apologize because I am using the word phase in an imprecise way I am considering systems 
at finite ^, albeit large, N jT^]: roughly speaking a phase is a region of phase space that is separated 
by other regions by a free energy barrier whose height goes to infinite when the volume goes to infinity. 
Other words, e.g. structures or lumps, may be more appropriate. However I will stick here to the 
more suggestive words phases or states: the reader should note that here they are defined in a large 
finite system. Always for finite system one can think that the Gibbs measure (neglecting a fraction 
vanishing with N) may be partitioned into regions that correspond to the states. The weight of each 
state {wa) in the decomposition of the free energy should be proportional to the exponential of the 
total free energy of the state, i.e. 

Wa oc exp(-/3/o) . (5) 

The lower lying states have a weight Wa that remains finite when N goes to infinity [3 15 • However we 
are interested in these lecture to the states that have a free energy density higher than the minimal one 
(metastable states) and therefore their contribution to the Gibbs measure will be exponentially small. 
Please notice that the existence of these states is limited to infinite-range models: real metastable 
states do not exist for short range model in finite dimensions ^. The relevance of these finding for 
short range models is discussed in many places, see for example [THj, and it should be done with great 
care. 

In these infinite-range models the internal energy (or the free energy) has have many minima (the 
states) and saddle points separating them: we must study the properties of the free energy landscape 

^The sine model has his own pecuharities and its properties will be not discussed here. 

^This last statement is not so crucial for the physics: we are usually interested in computing the behavior and the 
convergence time of an algorithm in the typical case, while the P-NP classification is based on the worst case. 

^Defining the states directly for the actual infinite system is sometime possible, but it is not simple; in other cases it is 
rather unnatural: for example in the sine model the Hamiltonian for a system of A*' spins is not near to the Hamiltonian 
for a systems of TV + 1 spins and we will not discuss further this point. 

""This is a mathematical theorem that should be taken cum granum salis, as far as the mean life of a metastable state, 
although finite, may be much larger of the mean life of the universe. 
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(that in this case is cahed corrugated): we would hke to understand the number and the relative 
positions of the states. Moreover, one would like to do this computation not only for the states that 
have a free energy near to the ground state, but also for those metastable states that have a free energy 
much higher than the ground state. 

One can approach this problem, following the suggestion of Monasson |141 115j , in the framework of 
purely equilibrium statistical mechanics; we have to compute the partition function of m replicas, or 
clones, with some restrictions on the overlaps of the configurations of these replicas. The information 
we need can be extracted (at least in some cases) from the values of this partition function: this 
approach is discussed for example in my Les Houches lecture notes of three years ago |13| and it will 
be only briefly summarized here. 

Here I will follow a different approach: a state is defined in terms of the local magnetizations and 
the local magnetizations satisfy some equations, the so called TAP equations, that become exact (with 
probability one) in the limit going to infinity jl61 1171 118j . Heuristically these equations imply that 
there is a long-lived structure: the corresponding local magnetizations satisfy the TAP equations. We 
have to solve the problem of counting the number of solutions of the TAP equations as function of 
the free energy and the relative distance of the solutions; eventually we have to understand how many 
solutions are minima of the free energy, and how many are /c-saddles, i.e. points where the Hessian 
has k negative eigenvalues. 

In the next section of this lecture I will present an heuristic derivation of the TAP equations for 
stable and metastable states. In the rest of the lectures I will compute the average number of solutions 
of these equations, which is a very well defined problem from a mathematical point of view. We will 
find that the total number of solutions for given values of the J behaves with at large as 



Although the most interesting quantity is the quenched complexity (defined as the mostly likely value 
of Sj) here for simplicity we will limit ourself to the computation of the so called annealed complexity: 



where the average is done over the different choices of the J's variables. Depending on the model 
and on the parameters of the models the quenched complexity may be strictly smaller or equal to the 
annealed complexity in the infinite- A^ limit. 

Computing the complexity is a particular case of the more general problem of finding all the 
stationary points of a random function of A^ variables, that in this case is the TAP free energy. In 
section 2 I will present the derivation of the TAP equations for the magnetizations of a metastable 
state and I will discuss their physical meaning. In section 3 I will present some simple considerations 
on the number of solutions of the TAP equations. In section 4 I will show the general strategy for 
computing the number of solutions of the TAP equations as function of the corresponding free energy. 
In section 5 I will show that this problem is invariant under the action of a Fermionic symmetry, a 
supersymmetry in short; this unexpected and astonishing results was derived a few years ago in |19! 
and it was the key of all the progresses of there recent years. In section 6 I will discuss the possibility of 
supersymmetry breaking and its implications, the most spectacular one is that most of the stationary 
points are one dimensional saddles, as predicted long time ago ^lEI- In section 7 I will present the 
explicit computation of the complexity in the SK model, sketching the different steps that have to be 
done. In section 8 I will just mention some of the problems that are present in computing the quenched 
complexity. Finally in section 9 I will summarize the results and mention some open problems. 

I believe that most of the computations that I present can be done in a rigorous mathematical way 
using existing techniques in a careful way (the computation of the quenched complexity may be much 
more difficult). I hope that these lectures will be an encouragement to do such a rigorous computation. 




(6) 



exp(ArS)) = exp(ArSj) , 



(7) 
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2 The TAP Equations 



I will derive the TAP equations on a random Bethe lattice jl6l 1^1 13 El where the average number of 
neighbors is equal to z and each point has a Poisson distribution of neighbors ^: the SK limit will be 
done later. 

Let us consider a node i\ we denote by di the set of nodes that are connected to the point i. With 
this notation the Hamiltonian can be written 

We suppose that for a given value of N the system is in a state labeled by a and we suppose such 
a state exists also for the system of — 1 spins when the spin i is removed. Let us call m{i)a the 
magnetization of the spin k and jTii^h] i^ct the magnetization of the spin k when the site i is removed. 
Two generic spins are, with probability one, far on the lattice: they are at an average distance of order 
ln(A); it is reasonable to assume that in a given state the correlations of two generic spins are small (a 
crucial characteristic of a state is the absence of infinite-range correlations). Therefore the probability 
distribution of two generic spins is factorized (apart from corrections vanishing in probability when N 
goes to infinity) and it can be written in terms of their magnetizations. 

After a simple computation we find for a given state labeled by a (the label a will not be indicated 
to lighten the notation): 



mil) 



tanh ^ artanh(tanh(/3 Jj^fc)m(A;; i)) . (9) 



In a similar way we finds that the cavity magnetizations m{k; i) are related to the magnetizations 
m{k) and m{i) by the relations: 

m{k) = tanh(artanh(m(/i;; i)) + artanh(tanh(/?Jj fc)m(i))). (10) 

In the case of the Bethe lattice the usual strategy is to write the equation directly for the cavity 
magnetizations. We obtain (for / E di): 



mil. 



I) = tanh ^ artanh(tanh(/?Jj^fc)m(A;; «)) . (11) 



Following this strategy we remain with Nz equations for the Nz cavity magnetizations m{i;k); the 
true magnetizations {m{i)) can be computed at the end using equation ©. 

In the SK limit (i.e. z ~ A), it is convenient to take advantage of the fact that the J's are 
proportional to A~^/^ and therefore the previous formulae may be partially linearized. If we throw 
away irrelevant terms, the previous equations become (as soon as z is large): 



m 



(i) =tanh I /3J,,km{k;i) ] , (12) 

kadi 



m{k) = m{k; i) + /3(1 — m{k) )Ji^ki^{i) . 

If we eliminate all the terms that vanish when N ^ oo, these two equations can be simply rewritten 
as 

m(i) = tanh(/3/i(i)), (13) 
H'i') = E Ji,k'm{k] i) = Ji,km{k) - [3m{i) ^ J^fc(l - m{k.f') . 

kGdi kGdi kGdi 



One can consider also a generalized random Bethe lattice where each site has a fixed coordination number: the 
treatment is similar, but slightly different. 
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In the SK limit the points in di are all the points different from i. Using the law of large numbers we 
can write 

m(i) = tanh(/3/i(i)), h{i) =Y, Ji,km{k) - P'm{i){l - q) , (14) 

where q is defined as 

„_E.m(i)2 



N ■ 

These equations are different from the naive mean field equations 



(15) 



m{i) = tanh(/3/i(i)), h{i) = ^ Ji,fc?Ti,(/c) . (16) 

The naive mean field equations can be derived using a variational approach where the probability is 
supposed to be factorized. In this way one neglects the weak correlations among the cr's and this leads 
to a wrong value of the free energy at non-zero temperature ^. On the Bethe lattice the argument is 
quite clear. The spins that belong to di are correlated because they are at distance 2 on the lattice; 
on the contrary the same spins are not correlated when the spin at i is removed (they are at distance 
of 0(ln(A^)) and therefore the factorization approximation can be done for the spins in di only when 
the spin at i is removed. 

The same argument can be formulated in a slightly more different way, that can be generalized to 
more complex cases. It is the cavity method, where one connects the magnetizations for a system of 
A'^ spins with the magnetizations for a system with A'^ — 1 spins. In absence of the spin i, the spins 
a{k) {k £ di) are independent from the couplings Ji^k- If we linearize the equations for the Bethe 
lattice, we obtain: 



mil) 



tanh ^ Ji^km{k; i) (17) 



m{k] i) = tanh ^ Jkjm{l; k, 

Here m{l; k, i) is the magnetization of the spin at I in absence of the spins at k and at i. A detailed 
computation shows that in this case, neglecting terms that go to zero (in probability) when A^ goes to 
infinity, we can substitute m{l;k,i) with m{l;k). Indeed the nodes i and / are at distance two when 
the node at k is present: however, when k is removed, they are far away in the lattice. In this way we 
recover eq. ©. 

Now we will concentrate on the SK model and we will use the formulation where we have A^ 
variables and A^ equations, i.e. the original TAP equations, eq. (|14jl . The corresponding total free 
energy is 

/N = E m{i)j^,km{k) - ^ E(i - "^w') - ^("^W)' (18) 

i,k i i 



where 



1 + m /l + m\ 1 — m /I — m\ 
5M = -^ln^ -^m^) . (19) 



The free energy is stationary: in other words the TAP equations can be written as 

df[m] 



dm{i) 



. (20) 



'^The naive mean field equations are exact equations for another model that is different from the SK model. Unfor- 
tunately they have not been so well studied in recent times. 
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However, as we shall see, that there is no variational principle for the free energy: the equilibrium 
value of the free energy is not the absolute minimum of the free energy. The Hessian of the free energy 
can be written as 

dm{i)dm{k) 
2/3 

where we have used the notation 



A{i) = p{l - m{if) . (22) 



The relation 

PH - ,) = . (23) 

may have not escaped the attention of the experienced reader. It is rather important because it can 
be used to prove that in the large- limit the Hessian does not have a non-zero fraction of negative 
eigenvalues f2D| . 

As we shall see later, we must resist the strong temptation of throwing away the last term that 
is a factor smaller than the others. Indeed, once that we have written the free energy, the 
Hessian is exactly given by the previous formula. Before throwing away a term, you must ponder all 
the consequences of your act: you may discover 24 years later that such an action was not justified 

[111112]! 

We must stress that there is an important consistency condition: the correlation among different 
spins must vanish in the large N limit. Fortunately they can be computed in this framework. After 
some computations we find that the correlations are small enough and the approach may be consistent 
only if the stability condition 

„ _ Y.i=i,nA{^^ _ , E/=i.7v(l - m{i)^? ^ . 

= ^ <1 (24) 

is satisfied. Indeed we find that 

X, ^ = ^ . (25) 

If i? > 1 the whole approach does not make sense. 

Using the spectral properties of the matrix J (for A'^ going to infinity the spectral density of this 
random matrix is a semicircle with boundaries at ±2) we find that the paramagnetic solution m{i) = 
is always a minimum of F. However the paramagnetic solution is no more in the stable region as soon 
as /? > 1, i.e. in the whole low-temperature region. For P > 1 the paramagnetic solution m{i) = 
should be disregarded because is not stable. 

The physical picture is clear. At low temperature the free energy has a deep minimum at the 
origin, however the physical relevant region does not contain the origin and the physical relevant 
minimum is the lowest minimum inside the stable region (R < 1). We should also notice that the 
equivalence among this approach (with N equations) and the cavity approach (with 0{N'^) equations) 
holds only if the stability condition is strictly satisfied and it is incorrect when the stability condition 
is not satisfied. 

In the more familiar case of a ferromagnet, the paramagnetic solution is no more a global minimum 
in the low-temperature case, while in spin glasses the paramagnetic phase is always the formal global 
minimum of the free energy. This difference has a profound influence on the behavior of the specific 
heat (in the mean field approximation): 
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• In the ferromagnetic case the specific heat in the low-temperature phase is larger than the ana- 
lytic continuation of the specific heat computed in the high-temperature phase. This corresponds 
to the fact that in the low-temperature phase the system explores new regions of phase space; 
this is the natural behavior when we have a variational approach without constraints. 

• In spin glasses the situation is the opposite: the specific heat in the low-temperature phase is 
smaller than the analytic continuation of the specific heat computed in the high-temperature 
phase. This corresponds to the fact that the system is frozen in the low-temperature phase and 
here the paramagnetic solution is only an illusion. This behavior is the effect of the constraints 
in the standard variational approach. This strange behavior is natural in the variational replica 
approach where the free energy is maximized (for good reasons and not minimized. It is 
interesting to note that experimentally in structural glasses the specific heat is discontinuous and 
it decreases when we cross the critical temperature coming from the high-temperature phase. 



3 A simple analysis of the solutions of the Bethe equations 

In the simplest approach we assume that in the low-temperature phase there is just one solution to 
the equations (fTl)) (neglecting the paramagnetic one). The field h{i) can be written using the cavity 
equation as the sum of A^ — 1 uncorrelated random terms with zero average ^: the Ji^k are uncorrelated 
with the m(z; k) so that Ji km{i] k) has zero average and the contributions with different values of k 
are uncorrelated. It is evident that the average value of m{i; k)'^ must be equal to q. The central limit 
theorem tell us that, when we change the Jj^fc, h{i) is a random variable with variance q |3]. 
We will now use the relation: 

m(i)2 = q , (26) 

where here the bar denotes the average over the couplings Jj^^. In this way we arrive at the so called 
replica symmetric equations for q: 

dfig{h)tanh{(3hf , (27) 

where dfj,g{h) denotes the Gaussian probability distribution with variance q. 

A simple analysis shows that for T < 1 there is a non-trivial solution with q ^ (the solution with 
q = is the paramagnetic solution that is unstable for T < 1) . However, if we compute the entropy 
at low temperature, we find the astonishing result that it is negative E]. This is possible because the 
total entropy is not the sum of the single-spin entropy and its explicit expression does not have an 
evident sign. Indeed, using the TAP free energy, we find that: 

S = J2S{m{i))-^{l-qf . (28) 

i 

In the limit T going to zero, if (7 — > 1 the first term vanishes, but the second is strictly negative, if 

lim /3(1 -q)>0 (29) 

and this is what happens as a simple consequence of equation (|27|) . 

Something goes wrong. The solution of the puzzle was found by De Almeida and Thouless |24j 
who discovered that as soon as T < 1 also the q ^ solution is unstable, i.e. it does not satisfy the 
stability condition H24|) and no stable solutions are available. After some hesitations, at the end of the 
day consensus was reached on the fact that the hypothesis of having only one non-trivial solution was 

*In doing these evaluations it is more convenient to use the equations 1121 we could also start from the equations 1141 
the results would be the same and the derivation would be slightly more involved. 
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inconsistent: we must take into consideration the existence of an infinite number of solutions of the 
TAP equations: this situation is called replica symmetry breaking [31 1^13] • 

The central quantity in the theory becomes now the set of all the solutions of the TAP equations 
and their corresponding free energies \21\ I25| I26| \'27\ I28j . In the simplest case we assume that the 
solutions are uncorrelated among themselves and that they are uncorrelated with the free energy. In 
other words we assume an approximate factorization property for the joint probability distribution of 
the total free energy and the corresponding magnetizations m°'{i), where the index a labels the 
different solutions of the TAP equations [HIE]- More precisely we suppose that 

Piif + /, m) = V{f + mU, m) , (30) 

where / is a quantity of order 1 and 

''dfV{f) = ^, (31) 

because this integral is the total number of solutions of the TAP equation. 
We now assume the probability V{f ) is approximatively given by 

exp(iVS(F)) (32) 

where F = f /N. This is a natural extension of our previous hypothesis on the complexity. The total 
complexity is given by 

S = maxS(F) . (33) 

In a similar way we assume that 

P,{f,m)=Vi{F,m) . (34) 
Under these assumptions the probability of finding a solution around f = F N can be written as 

nf + /) = nf) exp(2/(/ - /)) cx exp(y(/ - /)), (35) 
where / is a still quantity of order 1 and 

(^^' 

In this framework is natural to assume that, when the free energy is near to the minimal free energy 
(that we will denote by /o), the probability of finding a solution with total free energy given by /o + / 
behaves like 

V{f) oc exp(yo/) • (37) 

Also here / is a still quantity of order 1 while /o is a quantity of order N. I will use the notation 
y = (3m and yo = (3mQ, where quantities m and thq are not magnetizations, (I will stick to this 
traditional notation, hoping that there will be no confusion). 

In order to make further progress and perform explicit computations, we can write equations that 
relate the distribution of the magnetizations for a system with points to the distribution of the 
magnetizations for a system with + 1 points. We have to make the crucial hypothesis that there is 
a one to one correspondence between each solution of the TAP equations for A^ spins and for A^ + 1 
spins; as we shall see later this hypothesis fails at high value of the free energy, but it is reasonable 
for values of the free energy not too far from the minimal one. 

Let us consider the solutions that have a free energy density F. We need to know only the value 
of m. After some computations, described in my earlier Les Houches notes ^Hl one finds that 

dPN+iih) (X dfiq{h) tanh(/5/i)2 exp(/3mA/(/i)) , (38) 

where 

niN+i = tanh(/?/ijv+i) , (39) 
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and 

Af{h) = log(cosh(/3/i)) . (40) 

Consistency requires that 

q = J dPN+iih)itanh{phN+i))^ . (41) 

In this way we determine q but m is a free parameter. How can one determine m? It happens that 
it is possible to compute the free energy density F that corresponds to a value of m. This is done in 
the following way. 

We can define a thermodynamic potential <I>(m) such that 



d(3m 
d{l3m^{m)) 



S(F(m)) (42) 
F{m) 



d(3m 

In other words ^(m) is the Legendre transform of the complexity: 

(5m(^{m) = l3mF{m) - S(m) . (43) 

You may have a feeling of deja vu: indeed we recover a more familiar setting [^H] if we would do the 
following substitutions: 

F — > internal energy (44) 

$ — > free energy 
S entropy. 

It should be now clear why in some circles the complexity is called the configurational entropy [30[. 

If we know the the potential <I>(m), we know all we need to reconstruct everything, in particular 
the dependence of the complexity on m or on F. Fortunately an analysis, that it would be too long 
to describe here [T^, shows that <I>(m) has a simple explicit expression ^: 

/ + 00 
d/U5(/i)cosh(/3/i)™log(cosh(/3/i)) . (45) 
-oo 

A similar, but more complex expression for <^(m) can also be obtained on the Bethe lattice jB]. 

It turns out that the free energy is stationary with respect to q; indeed the correct value of q is 
obtained by maximizing the free energy with respect to q: the previous equation (|41|) corresponds to 
imposing the condition 

^ = (46) 

and the sign of the second derivative is such that the potential $ is a maximum with respect to q. 

We now face the problem of computing the minimal free energy (sometimes also called the ground 
state free energy. This is now an easy job if we make the natural hypothesis that the complexity 
vanishes when the free energy density becomes equal to the ground state. In other words the value of 
mo corresponding to the ground state energy is given by the condition 

S(mo) = . (47) 

However the previous equations tell us that 



The same expression for the free energy can be obtained using the traditional rephca approach. 
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In other words the condition of zero complexity at the ground state, imphes that the potential 
$(m) is stationary with respect to m. More precisely in order to compute the free energy of the 
ground state we have to maximize the potential $ with respect to both q and m: for the ground state 
we have an inverted variational principle. 

The formula for the potential <I>(m, q) is the one that has been obtained directly with the algebraic 
replica approach long time ago. Using Guerra's variational approach it can be shown from general 
principles that the maximization of the potential $(m, q) gives the correct result j32J. It is remarkable 
that the same formulae, that have been originally derived for the ground state, can be used for the 
computation of the complexity. This is one of the most astonishing result of Monasson's approach 
that we have just described. 

However in the previous derivation we have made the crucial hypothesis of the existence of a one 
to one correspondence of the solutions of the TAP equations with N and + 1 spins. At first sight 
this hypothesis is witless, because we know that the total number of solutions increase with a factor 
exp(S) when we go from A to A^ + 1. As we shall see later this apparently witless hypothesis may 
remain valid for some values of F. 

The rest of this lectures will be devoted to discussing when and why such an hypothesis is correct 
and to present alternative approaches in the case where it fails. The relations among the different 
approaches are non-trivial and they come out from some very interesting mathematics. 

4 The direct approach: general considerations 

Before starting the direct computation of the number of solutions of the TAP equations, I will present 
some general considerations on this kind of problems and I will write down some formulae that are 
valid in a more general case ESI EHl EH 1^ • 

I will consider a function f[x] where here x (among square brackets) denotes the set of A variables 
x{i), with i = 1,N. If the function / factorizes in the product of A non-linear functions, each 
dependent on only one variable x{i), the analysis is rather simple; in the case where each function has 
3 stationary points, the total number of stationary points of the function f[x] is 3'^. 

In the case where all the variables interact and no factorization is possible, the situation is rather 
complex; also in this case it is quite possible that we have an exponential large number of stationary 
points (i.e. points where df /dx = 0) . A very interesting question is the computation of the properties 
of these points, e.g their number and there relative location in space. If the number of the points 
diverges exponentially with A^, methods coming from statistical mechanics may be very useful. 

As we have seen in previous sections this problem is very relevant for statistical mechanics. Indeed 
if the function / is the free energy or the internal energy of a system, its local minima correspond 
to stable or metastable states at non-zero (or zero) temperature. The relative height and position of 
other stationary points, e.g. saddles, control the time from escaping from the metastable states and 
the approach to equilibrium. 

When the function / is the free energy, the shape of this function is called the free energy landscape. 
If the number of stationary points is very high, e.g. increases exponentially with A^, we have already 
seen that the landscape is called corrugated. A system with a corrugated landscape is a glassy system: 
indeed these investigations are often done to study glassy systems like spin glasses or structural glasses, 
although they could also be relevant for string theories. 

The first quantity that we have to compute is the total number of stationary points 




(49) 



or the total number of minima 




1, 



(50) 



aec, 



"m 
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where the C denotes the set of stationary points and those stationary points that are actually 
minima. 

Very often one is interested also in the distribution of the values of the function / at the stationary 
points (indeed there may be a physical interest in knowing the stationary points with the lowest value 
of /). It is therefore convenient to consider the two functions: 



M{F) =^5{F- /M) (51) 



aeC 



Z{w) = ^ exp(-'u;/[x«]) = j dFM{F) ex.p{-wNF) 



For large N we expect that 

M{F) f« exp(AfS(i^)) , Z{w) w exp{-N^{w)) , (52) 

where ^{w) and S(i^) are related by an Legendre transform (exactly as the free energy and the entropy 
in the usual formalism): 

^l^^w(^), (53) 

^{w{F)) = J:{F)-w{F)F . 

If we are able to compute the function Z{w) we can reconstruct, by an inverse Mellin transform, the 
function M{F) that codes the distribution of the values of the stationary points. In particular we have 
that 

Z{w)\^=o = eMN^) (54) 

Everything is very similar to what we have done in the previous section, with the difference that here 
we use a synchronic approach (wc look to what happens at a given value of N), while in the previous 
section we were using a diachronic approach (we were following the solutions of the TAP equations 
when N was changing). Here we do not need to make an explicit hypothesis on the continuity of the 
set of solutions with respect to N; however we shall see later how this continuity hypothesis can be 
reformulated in the synchronic approach. 

For the time being we will concentrate our attention on the quantity Z(w) that looks like a partition 
function, defined on an unusual space, i.e. the set of all the stationary points. It is important to 
remember that the function f[x] that appears in the weight is the same function that is used to 
determine the points of the sum, and this will be the origin of many identities. 

In order to make further progress let us assume ( happens for a generic function and for a generic 
stationary point ) that the determinant D[x] of the Hessian matrix H of the function f[x] is non-zero 
at the stationary points, i.e. 

O[xl.det|«|^0, n...= g££f^ (55) 

when df/dx = 0. In one dimension this condition corresponds to assuming that all stationary points 

arc minima or maxima (no flexes). If this happens we can define the index (/[a;]) of a stationary point; 
it is the number of negative eigenvalues of the Hessian; a minimum has index while a maximum has 
an index A^. An useful and evident relation is: 

(-l)^N = sign{D[x]) = D[x]/\D[x]\ (56) 

In the following we will consider for simplicity functions that are defined on a topologically trivial 
domain (e.g. an hypercube, the interior of a sphere or the whole space R^) such that the function 
f[x] diverges to plus infinity at the boundary. 
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Under these conditions it may be convenient to compute also the function 

Mw) = E (-1)""'^' eM-^fK]) , (57) 

Skipping technicahties, the celebrated Morse theorem states that 

In the one-dimensional case the Morse theorem states that, if lim^j^-i-oo f[x] = +oo, the number of 
minima minus the number of maxima is exactly equal to one, as follows from elementary considerations. 

The previous equations tell us that the behaviors ofM^w) and ofJ\f{w) are quite different, however 
it may be convenient to start with the computation of Af{w) that is much simpler than the other. 
Later on we will show how the computation of Af{w) can be recovered. Indeed a direct estimate can 
be done ^33^, following some ideas of Kurchan [3^133], using d'Oresme's identity 

\A\ = (^2)1/2 . (59) 

In order to compute J\f{w) we firstly notice that the sum over all the stationary points can be 
written as 

= f dx\DM\^ (%) (60) 



Therefore 



M{w)= [dxD[x] n 6{f^[x])exp{-wf[x]) (61) 

i=l,N 

Afiw)= [dx\D[x]\ n S{Mx])expi-wf[x]) 



i=l,N 

where from now on we shall use the notation 



^~ dx{i) ^''"^'^^ ~ dx{i)dx{k)- ^^^> 

Now the computation of N{w) is technically difficult because of the presence of the modulus of the 
determinant. It should be clear now why the function that can be computed more easily is N{w). 

In the rest of these notes we will stick to the computation of /^{w). Now, in order to do further 
manipulations, it is useful to write the determinant as an integral over Fermionic (anticommuting) 
variables using the formula. 

J l[{d^{i)di;{i)) exp(E Akmi'ik)) = det \A\ . (63) 

i i.k 

If we also use the integral representation for the delta function we obtain that 

M{w) = J dfi[X]eM-S[X]) (64) 

s[x] = Y,x{i)f{i)[x]+j2mmkk[^]+y^m , 

i i,k 

dn[X] ='[[dx{'i:)dipii)d4^idX{i) 

i 

where X{i) denotes a point of the superspace with coordinates x(i)'s, tpli) and A(«); the integral 
over the variables A is done in the complex plane from —ioo to +ioo. 
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5 The supersymmetric formulation 



The computation of A/'(u)) may be simplified if we notice that both the action S and the measure d/j, 
are left invariant under the following supersymmetry that was introduced in |19j : 

6x{i) = e(«)V'(i) 6X{i) = -e{i) wtpii) , 6ip{i) = e{i)X{i) 64^{i) = . (65) 

The appearance at 7^ of a supersymmetry, of the BRST type |3Z10H|) is unexpected, however it 
is well known that the Morse theorem, which states that Af{w)w=o = Ij can be proved in a neat way 
using the supersymmetric formalism. 

As usual supersymmetry implies identities among correlations of different quantities; in this 
particular case one finds after some computations |^1 OH 

imm) = {x{i)m) , (66) 
wimm) = (mm) ■ 

The derivation of the Fermionic symmetry is purely formal, therefore it would be nice to derive 
directly the Ward identities from the original equations without using too much the functional integral 
representation. We need to assume that when we make a small change in the equations, there is a 
one to one correspondence between the solutions before and after the perturbation. We also need to 
assume, but this assumption is related to the previous one, i.e. that the quantities that appear in the 
Ward identities are well-defined. 

In order to understand better the Ward identities |33| we notice that 

(mm) = {in-\k) , (67) 

where Tl is the Hessian matrix. The computation of the correlations of the A's, that, in the nutshell, 
are Lagrange multipliers, can be obtained by introducing the generating function: 

Z[h] = J dfxiX)exp (^-S{X) +J2H^)K^)j = (68) 

dxD[x] n d{fi[x]-hii))eM-wf[x]) . 

i=l,N 

In other words we count the number of solutions of the equations 

fi[x] = h(i) , (69) 

weighted with exp(— t(;/[x]), (not with exp(— t(;(/[x] — h ■ x)). As soon as h is different from zero, the 
constraints on the variables x and the weight are no more related and supersymmetry does no more 
hold. 

Let us make the crucial hypothesis that for infinitesimal h there is a one to one correspondence 
between the solutions of the equations 

fi[x] = h{r) (70) 

at zero h and at non zero h and that the solution at non zero h can be computed by a well-defined 
perturbative expansion in h around h = |48l l4Uj . It is now evident that at /i = 

(xmik)) = (|^) = {{n'\,) = mm) ■ m 



use the word supersymmetry in a somewhat improper way; the symmetry we have introduced contains an anti- 
commuting parameter, and it a Fermionic symmetry, but in the standard terminology a bona fide supersymmetry group 
should contain also the generator of the space translations, that is not the case here. 

^^This supersymmetry does not have a very simple geometrical interpretation in superspace also because the trans- 
formation depends on w; it is not clear to me if the whole approach may be reformulated in such a way that the 
supersymmetry has a more geometrical meaning. 
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And in this way we recover the first Ward identity, the one where w does not appear. 

In a similar way if we work up to the second order in h in the free energy, we can derive the first 
order result for the stationary point 



6x{i) = x{i)[h] - x{i) = Y,i'H~\kSh{k) + 0{h'^) . 



(72) 



k 



The variation of the function / starts at the second order in the perturbation 



<5/ = -'^Sx{i)ni,kSx{k) 



i,k 



-Y.5h{i){H-\kSh{k). 



i,k 



(73) 



Putting everything together we get: 



(mm) 



d^z[h] 



w{{n~\k) = (mm) ■ 



(74) 



dh{i)dhk 



h=0 



which is the second Ward identity, i.e. the one that depends on the w. 

Supersymmetry is an efficient way include relations of purely geometrical origin between the cor- 
relations of the Bosonic variables, which play the role of Lagrangian multipliers, and the correlations 
of the Fermionic variables, which have been used to evaluate the inverse of the Hessian matrix and its 
determinant. 

6 Spontaneous supersymmetry breaking 

It may seem strange that I am speaking of spontaneous breaking of the supersymmetry just after having 
proved that supersymmetry encodes simple identities among various quantities j42j. However these 
identities were derived under the critical hypothesis of the existence of a one to one correspondence of 
the solutions of the equations after and before a perturbation. This is reasonable only if the generic 
solution of the system is not near to a bifurcation and this is possible if the Hessian matrix does not 
have a zero or a quasi-zero mode. Everything was based on the hypothesis that the Hessian matrix 
at the stationary points had no zero-mode. 

If we average the function / inside a given class, we may integrate over regions where zero-modes 
are always present and our assumptions fail. Moreover in such a case TC~^ is infinite and we have 
problems defining the expectation value of ij~i~^)i^k- 

Still worse, if we write 



when we take the derivative with respect to h of this quantity, we have to take into account in an 
explicit way the fact that the set of solutions labeled with a changes may with h. This looks like 
a cauchemar but it is possible to do explicit computations in the framework of the cavity method 
of the previous sections 40 . One finds that the results are different from the usual supersymmetric 
approach and they coincide with the one obtained by assuming that supersymmetry is spontaneously 
broken [10] . 

We could try to avoid the problem by adding a small term in the weight in order to suppress the 
contribution coming from stationary points with zero modes, but this extra term breaks explicitly 
the supersymmetry and it is not surprising that in the thermodynamic limit supersymmetry breaking 
may survive when we remove the extra term j4f)j . However computation can be done in presence of 
this extra term and this is probably the simplest approach to study the problem on a Bethe lattice. 

Summarizing there are two alternative explicit approaches: 

• We take care in an explicit way of the effects of the the birth or of the death of solutions when 
changing A'^ [10] . 




(75) 



a 
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• We force the solutions to be stable by adding a small perturbation |46j . 

Both approaches allow explicit and correct computations and deeply clarify the physical situation. 
Here for reasons of space I cannot describe more explicitly the diachronic approaches and I will limit 
myself to the simplest synchronic approach, that has the disadvantage that it cannot be easily extended 
to Bethe lattice (although it could be done with some effort). 

Up to now we have seen from general arguments that, if supersymmetry is broken, there must 
be some zero-modes floating around. Doing explicit computations for the TAP equations for the SK 
model it was argued numerically in [52] that in this case the generic stationary point has exactly one 
near zero modes and most of the stationary points come in pairs at distance N~^/'^ one from the other: 
they coalesce when N ^ oo and they becomes saddles as it was argued a long time ago ^1 EI and 
firstly seen numerically by . These results have been carefully verified numerically |22| I42j ; it was 
finally explicitly shown that the zero mode is the Goldstone Fermion of broken supersymmetry j44j 
and its existence follows from the general Ward identities of broken supersymmetry. 

It is possible to show that in many models there are values of the parameters where some kind of 
SuSy breaking is needed 011 IMl EOI ■ Let us consider the usual case, where the function H itself 
changes in a continuous way when going from iV to A*" + 1. For example in the case of the SK model 
(where according to the usual notation the x's are called m) we have. 

fN+i[{m},m{N + l)]=fN[{m}]+Af[{m},m{N + l)] , (76) 

where {m} represents the set of all m's for i = 1 . . . N , Delta f[{m},m{N + 1)] is a quantity that is 
usually of order 1, but whose derivatives with respect to m(i), for i < N + \ vanishes when N goes to 
infinity. Its explicit expression in the SK model is: 

A/[{m}, m{N + 1) = L{m{N + 1)) - m{N + 1) ^ Jiv+i,fcm(A:) + . . . (77) 

k 

where L(m) is a quantity of order one. The quantity JN+i,kfn{k) is also of order 1, but each 
individual term is of order N~^^'^. Finally the dots represent other similar terms, that must be taken 
into account in the exact computation, but have characteristics similar to the terms that we have 
explicitly written. Neglecting for simplicity the dots (they do not change qualitatively our analysis), 
the equations can be written as: 

dL 

JN+i,km{k) , (78) 



dm{N + 1) 

dfN[{m]] 
dm{k) 



JN+i,km{N + 1) 



The terms proportional to JN+i,k are of order one in the first equation, but they appears as a pertur- 
bation (they are of order N~^/'^) in each of the other A'^ equations. 

Let us compare what happens for a system with A^ + 1 variables with a system of only A^ variable. 
In this second case the equations are 

Let us assume for sake of simplicity that the first equation in ea. (|79|) (i.e the one for the variable 
m(A+l)) has only one solution where the r.h.s is fixed. In this case there is a one to one correspondence 
between the solutions of a system with A + 1 variables and the solutions for a system with A^ variables 
that are obtained by perturbing the original set of equations for the m variables (i.e. ea. H79() ). When 
we go from eq. (|79|) to the two equations in ([79|l . solutions may be created or destroyed only in pairs, 
and this is possible only if these solutions have nearly one zero mode. The unavoidable consequence is 
that, if the first equation of eq. (|79j) has a unique solution, the number of solutions may increase with 
N only if there are small eigenvalues of the Hessian floating around. 
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Therefore, if the number of solution increases exponentially with A^, i.e. the total complexity is 
not zero, zero modes must be present some values of the parameters and they would play a role there. 
The same argument works for external perturbations: the number of solutions of the TAP equations 
decreases when we increase the field or increase the temperature (the complexity becomes zero at large 
magnetic field or at large temperature) and therefore zero modes must be present somewhere. 

At the end of this analysis we find that there must always be a region where zero-modes are present: 
there our assumptions on the absence of zero modes fail and supersymmetry breaking is present. It is 
difficult to escape the conclusion that supersymmetry is broken only for the total complexity; however 
this result works only for the total complexity: as soon as we look at the constrained complexity at 
F 7^ Ft the argument is no more compelling. 

The following scenario is clearly possible and it is realized for example in the spherical p-spin 
models, as can be seen by explicit computations. With probability 1, the solutions with free energy 
density less than Ft have a gap in the spectrum of the Hessian, that here is totally positive: the 
probability of finding a zero mode can be computed and it is exponentially small with A'^ |43| IBOj . Here 
the physical picture is clear: when we go from A'^ to A'^-l- 1, the solutions aX F < Ft are stable and they 
only diffuse in free energy when N is changed. Coalescing of solutions (and the inverse phenomenon 
of the births of a pair of solutions) may happen only &t F = Ft- This complex phenomenon, which 
happens a,t F = Ft, does not forbid the computation of the complexity ai F ^ Ft and, by the magic 
hypothesis of continuity of the complexity as function of the free energy density, also aX F = Ft- In 
this way the whole computation of the complexity could be done aX F ^ Ft without even having to 
mention the creation and the slaughtering of the solutions that happens at F = Ft- 

This arcadian scenario is implemented in some models and for some time it was believed that it 
was the only possibility. However now we have realized that other scenarios are possible and the idyllic 
world of spherical models was a rare exception. 

Before discussing what could happens in the various models, it is better to consider an explicit 
case, the SK model, where computations can be done up to the end. This will be done in the next 
section. 



7 An explicit computation: the complexity of the SK model 

I present here the explicit computation of the complexity in the case of TAP equations for the Sher- 
rington Kirkpatrick model using the synchronic approach. I will only consider the computation of 
the annealed complexity .21t .39t i48j and I will only mention at the end the problems related to the 
computation of the quenched complexity. 

I recall the formulae introduced before. The TAP free energy is given by 

/N = E ^m,km{k) - ^(1 - g2) _ TY,S{m{i)) , (80) 

i,k i 

where g is a shorthand notation for ^i'm^i)'^ /N and S{m) is the usual binary entropy. The corre- 
sponding equations for the stationary point are 

rartanh(m(f)) - ^ Ji,k'm{k) - (3m{i){l - q) = (81) 

and the matrix elements of the Hessian are given by 

9^ f 26 
= « = --^i^k + SiMM^-' + - q)) + -^m{i)m{k), (82) 

om{i)om{k) iV 

^^We denote by Ft the value of the free energy at the maximum of the complexity, i.e. the free energy that we obtain 
if we compute the total complexity. 
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If we plug the previous equations in the representation eq. (|65|) and we neglect the term 1 /N in the 
Hessian, (an operation legal only for the computation of the leading exponential term in Z{w)) we get 

Z{w) = dn[X]exp{n[X]) 
n[X] = J2 A(i)(rartanh(m(i)) - ^ Ji,km{k) - (3m{i){l - q)) + (83) 

i k^i 

iP{i)iP(k)Ji,k + 6i,k{A{ir^ + /3(1 - q)) 

i,k 



-w 



-\ Y: mm,,m{k) - ^(1 - q') - T^] 5(m(i)) 

i,k i 



We face now the problem of computing the average over the couplings J: quite fortunately they 
appear at the exponent in a linear way. We can thus write 

^[X] = ^[X]\J=o + Y,^,^kJ^,k (84) 

i,k 

- W 

^i,k = \{i)m{k) + ip{i)'ip{k) — —m{i)m{k) . 
The integration over the J is Gaussianly trivial and we obtain 

Z{w) = dfi[X]exp |^f)[X]|j=o + ^EKfc + ^M)'j (85) 

In order to proceed further we must follow-the strategy of decoupling the different sites by intro- 
ducing the appropriate global integration parameter. At this end we can use Gaussian representations 
like 

exp |^^^m(i)2m(A;)2j oc y"dQexp ||-^Q2 + Q^m(i)2j . (86) 

In doing that we have to introduce many parameters Qu,fi for u, = 1, 4, that are respectively conjugate 
to the variables 

YX{i),X{i),, (87) 

i 

with 

X{i)i=m{i), X{i)2 = m, X{i)3 = m, X(i)4 = A(i). (88) 

At the end of the day we arrive at an integral over 16 variables Q (there are some reductions if we 
take into accounts symmetries and identities, but I will not enter into these details), that has the form 

J d{Q}exp{NC{Q)) . (89) 

There are 8 Bosonic Q, that are conjugated to Bosonic variables like m[i)'^, X{i)m{i), ■ilj{i)ip{k) and 8 
Fermionic Q, which are conjugated to Fermionic variables like m{i)ijj{i). 

The presence of Fermionic variables is crucial to make the supersymmetry manifest, but at the 
saddle point we can put the Fermionic Q's equal to zero, however their presence is going to influence 
the corrections to the saddle point, determining in this way the prefactor in front of the exponential 

mi. 

If we eliminate the Fermions and if we use the fact that the matrix Q is symmetric and that V'(^)^ 
is zero, we remain fewer parameters Q. Finally we can take as parameters or the surviving Q's or 
their conjugated parameters: they are 

A ^ (A(.)'), A ^ (A(i)m(i)), q = (m(i)2), B = {i^ii)^) " " (90) 
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We can write the quantity C{Q) by solving the the equations for the Q's and expressing it as function 
of A, A, q and B: 

C{A,A,q,B). (91) 

The value of these parameters can be obtained by imposing that the function £(A, A, q, B) is stationary 
with respect to them. The final equations do have a solution with i? = that turns out to be the 
correct one: i? = implies that the diagonal elements of the inverse of the Hessian are (in the average) 
the inverse of the diagonal elements of the Hessian) . 

If we stick to the B = Q solution, one finds (numerically) that there are two others solutions: 

• The supersymmetric solution where A = A = j3{\ — q), that depends only on one parameter. It 
can be proved that this supersymmetric solution exactly corresponds to what would be obtained 
using the Monasson approach J3^. 

• The original solution found by Bray and Moore 25 years ago, where A ^ A ^ (3{1 — q), that 
depends on three parameters. 

It is not evident at first sight which of the two is the correct solution, however if we compute the 
average of /3^(1 — m(i)^)^ — 1 we find that it is negative on the supersymmetric solution and therefore 
only the non-supersymmetric solution is consistent. 

If we further compute the spectrum of the Hessian neglecting the last term in equations 1821 we find 
that it is positive definite and all eigenvalues are greater than than a quantity G greater than zero 
|21j . Obviously this result does not make sense, because it implies that all the stationary points of 
the free energy are minima, which is in patent contradiction with the Morse theorem. What saves the 
day is the extra term in the Hessian 

23 

-^m{i)m{k) . (92) 

An explicit computation j22j shows that while its effect is negligible as far the spectral density is 
concerned, it can shift those few eigenvalues whose eigenvector have a finite projection in the direction 
of the vector m{i). At the and of the day one finds that there is one eigenvalue that is shifted exactly 
to zero and it plays the role of the Goldstone Fermion of spontaneous supersymmetry breaking j44j . 

The extension of these computations to the Bethe lattice is non-trivial, however, progress has been 
maid [Ml EH ESI- 



8 A few words on quenched complexity 

The computation of the quenched complexity is much more complicated (and it is also more interest- 
ing). Quenched complexity is defined as 

^quenched = Sj = N'^ log(#Solutions) , (93) 

where the average is done over the different realizations of the system (that are labeled by J). Usual 
arguments tell us that the quenched complexity coincides with the typical case complexity in the 
large- A'^ limit. 

The replica method may be used to compute the average over the control variables J and everything 
becomes more difficult. Replica symmetry must be broken to perform the computation and it would 
be much more difficult to say something rigorous on the subject. 

Generally speaking we have seen that the computation of the number of solutions of the TAP 
equations (done without replica symmetry breaking) corresponds, in the super symmetric case, to the 
evaluation of the free energy in the case where the replica symmetry is broken at one step. In the 
quenched case, when we have to break replica symmetry also in the computation of the number of 
solutions of the TAP equations, one finds in a very elegant way that also here, if supersymmetry is 
exact, the explicit computation with K levels of replica symmetry breaking gives the same results 
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as the one within the Monasson approach with K + 1 levels of replica symmetry breakings j521 153j . 
Unfortunately in the SK model, this result has a very limited range of applications because as soon 
the free energy becomes greater that the the minimal free energy the solution becomes unstable 
and - m(i)2)2 less than 1 gH]. 

On the other hand for F near to Fm the simple super symmetric breaking solutions seem to be 
OK. When F becomes smaller than Fc > F^ replica symmetry must be broken and computations 
becomes very difficult, especially if also super symmetry is broken. 

On the other hand it may be possible that in the case where the Monasson approach works, the 
computation could be done by a not too difficult extension of Talagrand's results. 

9 Conclusions and open problems 

Different models may behave in a different way. Let me summarize what is known at the present 
moment. The most common possibilities in the computation of the annealed complexity for a given 
value of F are the following: 

• I: The generic stationary point is a minimum (index 0) and the modes are strictly positive: here 
supersymmetry is exact. 

• IIi: The generic stationary point may be not a minimum. There is a mode that has an eigenvalue 
that is nearly zero: there is a gap in the spectrum due to the other modes being greater that a 
positive constant. The stationary points come in pairs; the two stationary points of the pair are 
very near: one has a slight positive eigenvalue and the other has a slight negative eigenvalue. In 
the infinite limit the two stationary points coalesce to form a saddle point. This is the typical 
situation in the case of broken supersymmetry ^SJ . 

• IIqo: There is no gap in the spectrum: there may be one or more negative modes, but the number 
of negative modes remains bounded when — > oo. This typically happens at the critical point 
that separates exact supersymmetry and spontaneously broken supersymmetry [HH] , 

• IIIoo: The number of negative modes diverges when — > oo. This usually may happen when 
F > Fj^i and it is not a very-well studied case: some additional difficulties may be present as 
pointed out in 28 . 

For the quenched complexity there are other possibilities, due to possible breaking of replica symmetry 
and we are not going to explore this case. 

It evident from the Morse theorem that case I cannot be always true and in particular it cannot 
be true at Fm where the complexity reaches its maximum. 

Both in cases I and IIi the function and 5](-F) should be the same (the difference should be 

only in the prefactor), in the case IIoo it is possible that the two functions are different but in this 
case the value of S(-F) has a marginal interest. 

Generally speaking minima, or low index stationary points, are most likely at highly negative F. 
Therefore we expect that at the point F^ where Tj{Fm) = we stay in phase I. At Fm we must stay 
in phase II. There must be a value of F, F^ that separates the two phases and it is often in the phase 

IIoo. 

Different possibilities are realized in the region Fm < F < Fm] 

• The whole region is in phase IIi. This is what happens in the SK model. 

• The whole region is in phase I. This is what happens in simple p-spin spherical models. 

• The region where F^, < F < Fc is in phase IIi. The region where Fc < F < Fm is in phase I. 
The point Fc is in phase IIoo- This is what typically happens in the p-spin Ising models j^. 
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Although much progress on this field have been done in these years (especially after [SI OH] ) there 
are still many points that are not clear. I will end these lectures by mentioning a few ones: 

• A careful study of the quenched case where both supersymmetry and replica symmetry are 
broken. 

• A better understanding of the low-temperature phase on the Bethe lattice, especially for models 
that are of interest in combinatorial optimization. 

• The extension of the analysis to the short range models. Here the situation would be quite 
different; real metastable states with infinity mean life and with a free energy density greater 
than the equilibirum one cannot be present. The definition of the metastable states with a 
finite free energy difference with the ground state becomes imprecise, although this imprecision 
becomes smaller and smaller when the free energy density becomes very near to the equilibrium 
free energy. On the other hand the computation of the number of solutions of TAP like equations 
remains well defined and it is possible that it could be easier to make progresses in this direction. 

• The precise relation of the dynamics behavior with these static findings. More generally we need 
to start to compute barriers between different equilibrium states. A first step in this direction 
was done in but the results should be systematized. 

• A systematic study of Z{w) should be done, extending the results of |33] . 

As I have already stressed many of the results presented here are not out of reach of rigorous analytic 
computations. It would be very interesting to see them. It is quite likely that they would provide a 
new and very useful view on the field. 

Acknowledgments 

I am very happy to have the possibility to thank all the people that have worked with me in the field: 
Alessia Annibale, Andrea Cavagna, Andrea Crisanti, Silvio Franz, Irene Giardina, Luca Leuzzi, Marc 
Mezard, Andrea Montanari, Federico Ricci-Tersenghi, Tommaso Rizzo and Elisa Trevigne. 



20 



References 

[1] S.F. Edwards and P.W. Anderson, F 5 (1975) 965. 

[2] D. Sherrington and S. Kirkpatrick, Phys. Rev. Lett. 32 (1975) 1792. 

[3] M. Mezard, G. Parisi and M.A. Virasoro, Spin Glass Theory and Beyond, (World Scientific, 
Singapore, 1987). 

[4] G. Parisi, Field Theory, Disorder and Simulations, (World Scientific, Singapore 1992). 

[5] T. Castellani and A. Cavagna J. Stat. Mech. (2005) P05012. 

[6] M. Mezard and G. Parisi, Eur. Phys. J. B 20 (2001) 217, J. Stat. Phys 111 (2003) 1. 

[7] S. Franz and M. Leone, J. Stat. Phys 111 (2003) 535 

[8] E. Marinari, G. Parisi and F. Ritort, J. Phys. A 27 (1994), 7647. 

[9] A. DegU Esposti, C. Giardina, S. Graffi, S. Isola, J. Stat. Phys. 102 (2001) 1285. 

[10] M. Potters and G. Parisi Europhys. Lett. 32 (1995) 13. 

[11] CM. Newman and D.L. Stein, Phys. Rev. Lett 72, (1994) 2286 ; J. Stat. Phys. 82 (1996) 1113. 

[12] E. Marinari, G. Parisi, F. Ricci-Tersenghi, J. Ruiz-Lorenzo and F. Zuhani, J.Stat. Phys. 98 (2000) 
973. 

[13] G. Parisi in Slow Relaxations and Nonequilibrium Dynamics in Condensed Matter : Les Houches 
Session LXXVII, ed. by J.L Barrat, M.V. Feigelman, J. Kurchan, J. Dalibard, (Springer Berlin 
2003). 

[14] R. Monasson, Phys. Rev. Lett. 75 (1995) 2847. 
[15] S.Franz and G. Parisi, J. Physique I 3 (1995) 1819. 

[16] D.J.Thouless , P.W. Anderson and R.G. Palmer, Phil. Mag. 35 (1977) 593. 

[17] P.W. Anderson, /// condensed matter, edited by R. Balian, R. Maynard and G. Toulouse, (North- 
Holland 1983). 

[18] G. Parisi cs.CC/0212047. 

[19] A. Cavagna, J.P. Garrahan and I. Giardina, J. Phys. A: Math. Gen. 32 (1998) 711. 

[20] T. Plefka cond-mat/0310782. 

[21] A.J. Bray and M.A. Moore J. Phys. C 13 (1980) L469; J. Phys. C 13 (1980) L907; J. Phys. A 
14 (1980) L377. 

[22] T. Aspelmeier, A.J. Bray, M. A. Moore, Phys. Rev. Lett. 92 (2004) 087203. 

[23] F.Guerra, this volume. 

[24] R.L. de Almeida, D.J. Thouless, J. Phys. A 11 (1978) 983. 

[25] C. De Dominicis , M. Gabay , T. Garel and H. Orland, J. Physique 41 (1980) 923. 

[26] F. Tanaka and S.F. Edwards, J. Phys. F 10 (1980) 2769. 



21 



[27] C. De Dominicis and A.P. Young, J. Phys. A 16 (1983) 2063. 

[28] M. Potters and G. Parisi J. Phys. A 28 (1995) 5267. 

[29] A.C.D. van Enter, J.L van Hcmnicn, Phys. Rev. A 29, (1984) 355. 

[30] P.G. Debenedetti and F.H. StUlinger, Nature 410 (2001) 259. 

[31] F.Guerra, Comm. Math. Phys. 233 (2002) 1. 

[32] M. Talagrand, Ann. Math, to appear. 

[33] G. Parisi and T. Rizzo (in preparation). 

[34] G. Parisi and N. Sourlas, J. Phys. Lett 41 (1980) L403. 

[35] J. Kurchan J. Phys. A: Math. Gen. 24 (1991) 4969; cond-mat/0209399. 

[36] N. d' Oresme Algorismus proportionum (1358), see also De Proportionibus Proportionum (Uni- 
versity of Wisconsin Press Madison 1966). 

[37] C. Becchi , A. Rouet and R. Stora Phys. Rev. Lett. 52B (1974) 344. 

[38] Tyutin I V 1975 Lebedev preprint FIAN 39, unpublished. 

[39] A. Cavagna, I. Giardina, G. Parisi and M. Mezard, J. Phys. A 36 (2003) 1175. 

[40] A. Cavagna, L Giardina and G. Parisi, Phys. Rev. B 71 (2005) 024422. 

[41] K. Nemoto and H. Takayama, J. Phys. C 18 (1985) L529. 

[42] A. Cavagna, LGiardina and G. Parisi, J. Phys. A 30 (1997) 7021; Phys. Rev. Lett. 92 (2004) 
120603. 

[43] A. Cavagna, LGiardina and G. Parisi, Phys. Rev. B,57, 11251 (1998) 

[44] G. Parisi, T. Rizzo, J. Phys. A 37 (2004) 7979. 

[45] A. Annibale, A. Cavagna, LGiardina and G. Parisi, Phys. Rev. E 68, (2003) 061103. 

[46] T. Rizzo cond-mat/0404729. 

[47] Crisanti, L. Leuzzi, and T. Rizzo, Euro. Phys.Eur. Phys. J. B, 36, 129-136 (2003) . 

[48] A. Crisanti, L. Leuzzi, G. Parisi and T. Rizzo, Phys. Rev. B, 68 (2003) 174401 Phys. Rev. Lett. 
92, (2004) 127203; Phys. Rev. B 70 (2004) 064423. 

[49] A. Annibale, G. Gualdi and A. Cavagna J. Phys. A 37 (2004) 11311 

[50] A. Crisanti, L. Leuzzi, T. Rizzo Phys. Rev. B 71, 094202 (2005). 

[51] T. Rizzo, J. Phys. A 38 (2005) 3287. 

[52] A. Annibale, A. Cavagna, L Giardina, G. Parisi and Elisa Trevigne, J. Phys. A 36 (2003) 10937. 
[53] A. Annibale, A. Cavagna, I. Giardina and G. Parisi, Phys. Rev. E 68 061103 (2003). 
[54] T. Rizzo, J. Phys. A 38 (2005) 3287. 
[55] G. Parisi, T. Rizzo, cond-mat/0411732. 



22 



